A Reinforcement Learning Theory for Homeostatic Regulation
نویسندگان
چکیده
Reinforcement learning models address animal’s behavioral adaptation to its changing “external” environment, and are based on the assumption that Pavlovian, habitual and goal-directed responses seek to maximize reward acquisition. Negative-feedback models of homeostatic regulation, on the other hand, are concerned with behavioral adaptation in response to the “internal” state of the animal, and assume that animals’ behavioral objective is to minimize deviations of some key physiological variables from their hypothetical setpoints. Building upon the drive-reduction theory of reward, we propose a new analytical framework that integrates learning and regulatory systems, such that the two seemingly unrelated objectives of reward maximization and physiological-stability prove to be identical. The proposed theory shows behavioral adaptation to both internal and external states in a disciplined way. We further show that the proposed framework allows for a unified explanation of some behavioral pattern like motivational sensitivity of different associative learning mechanism, anticipatory responses, interaction among competing motivational systems, and risk aversion.
منابع مشابه
Collecting reward to defend homeostasis: A homeostatic reinforcement learning theory
Efficient regulation of internal homeostasis and defending it against perturbations requires complex behavioral strategies. However, the computational principles mediating brain’s homeostatic regulation of reward and associative learning remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learning mot...
متن کاملCuriosity-driven reinforcement learning with homeostatic regulation
We propose a curiosity reward based on information theory principles and consistent with the animal instinct to maintain certain critical parameters within a bounded range. Our experimental validation shows the added value of the additional homeostatic drive to enhance the overall information gain of a reinforcement learning agent interacting with a complex environment using continuous actions....
متن کاملAn integrated homeostatic reinforcement learning theory of motivation explains the transition to cocaine addiction
متن کامل
Homeostatic reinforcement learning for integrating reward collection and physiological stability
Efficient regulation of internal homeostasis and defending it against perturbations requires adaptive behavioral strategies. However, the computational principles mediating the interaction between homeostatic and associative learning processes remain undefined. Here we use a definition of primary rewards, as outcomes fulfilling physiological needs, to build a normative theory showing how learni...
متن کاملThe Discriminational Role of Reinforcement sensitivity theory, Emotion Regulation Processes Strategies and Cognitive Flexibility in Discrimination of People with Internet Addiction
The present study was conducted with the aim of determining the discrimination role of reinforcement sensitivity theory, emotion regulation processes strategies and cognitive flexibility in discrimination of people with internet addiction. The research design was a two-group diagnostic function. The study population included Internet user students at Imam Khomeini International University in Qa...
متن کامل